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SUMMARY 


In  _rtis  paper  -we  derives  the  stationary  probability  distribution 
for  the  inventory  position  at  each  location  in  a two  echelon  inventory 
system.  The  inventory  system  consists  of  a depot  and  a set  of  bases. 
All  system  demands  are  assumed  to  originate  at  a base  in  the  second 
echelon.  Bases  are  resupplied  as  necessary  by  the  depot,  the  first 
echelon;  the  depot  is  resupplied  by  an  external  supplier.  Each  loca- 
tion is  assumed  to  follow  a continuous  review  (S,s)  policy.  All 
excess  demand  is  assumed  backordered.  Furthermore,  the  process 
generating  demand  at  each  base  is  assumed  to  be  a Poisson  process. 

A simple  queuing  analysis  is  used  to  obtain  the  probability  distri- 
bution for  inventory  position.  In  the  case  where  all  bases  have 
identical  arrival  rates  and  follow  the  same  (S,s)  policy,  we-  show h 
that  the  random  variables  describing  the  inventory  position  at  each 
location  are  uniformly  distributed  and  are  independent. 


I . INTRODUCTION 


In  this  paper  we  derive  the  stationary  probability  distribution 
for  the  inventory  position  at  each  location  in  a two  echelon  inventory 
system.  By  inventory  position  we  mean  on-hand  plus  on-order  inventory 
minus  backorders.  Once  this  distribution  is  known,  the  stationary 
probal'ility  distributions  for  both  backorders  and  on-hand  inventory  can 
be  found  for  each  location  in  the  system.  These  distributions  can  then 
be  used  to  find  the  optimal  values  for  the  inventory  policy  variables. 

The  two  echelon  system  we  will  examine  consists  of  a depot  and  a 
set  of  bases.  The  depot  is  the  first  echelon,  and  the  bases  are  the 
second  echelon.  All  demands  are  assumed  to  originate  at  a base  in  the 
second  echelon.  The  demands,  for  example,  could  be  for  a replacement 
part  for  an  aircraft.  The  bases  are  resupplied  as  necessary  by  the 
depot;  the  depot,  in  turn,  is  resupplied  by  an  external  supplier.  The 
flow  in  the  system  is  displayed  in  Figure  1. 


Depot 


Base  n 


Inventory  Flow 


Figure  1 


Wo  also  assume  each  location  follows  a continuous  r'eview  (S,s) 
policy;  that  is,  whenever  the  inventory  position  at  a location  falls 
below  s+1,  an  order  is  immediately  placed  for  an  amount  sufficient 
to  raise  that  location's  inventory  position  to  S.  Furthermore,  if 
on-hand  inventory  at  a location  is  insufficient  to  satisfy  a customer 
order,  we  assume  the  excess  demand  is  backordered. 

The  stationary  probability  distribution  for  the  inventory  posi- 
tion has  been  derived  by  many  authors  for  single  echelon  systems 
operating  under  various  continuous  review  policies  [1,3, 5, 7, 8].  This 
distribution  has  also  been  obtained  for  two  echelon  systems  in  vjhich 
all  bases  follow  continuous  review  (S,S-1)  policies  [2,6]. 

The  remainder  of  the  paper  is  divided  into  two  major  parts.  In 
the  next  section  we  show  how  the  probability  distribution  for  the 
inventory  position  can  be  obtained  for  each  base  and  the  depot.  A 
simple  queuing  analysis  is  used  to  obtain  the  results.  In  Section 
III  we  restrict  attention  to  the  situation  where  all  bases  have  the 
same  arrival  rates  and  follow  identical  (S,s)  policies.  In  this 
case,  the  random  variables  describing  the  inventory  position  at  each 
location  are  uniformly  distributed  and  are  independent. 


II.  CASE  I:  UNEQUAL  ARRIVAL  RATES 


AND  POLICY  VALUES  AT  THE  BASES 


Sufipose  the  inventory  system  consists  of  n bases  and  a depot. 
Also,  we  assume  in  the  remainder  of  the  paper  that  the  process  gen- 
erating demand  at  each  base  j is  a Poisson  process  with  rate  , 
i = l,...,n.  We  let  S^  and  s.  represent  the  values  of  the 
inventorv  policy  variables  at  base  i,  j = 1 , . . . ,n ; S^  and 
denote  the  values  for  the  depot  policy  variables;  Z^.  represents  the 
inventory  position  for  base  i , j = l,...,n;  and  Zq  denotes  the 
depot  inventory  position.  Our  objective  is  to  derive  the  stationary 
distribution  for  Z^  and  Z.,  j = l,...,n. 

The  distribution  for  Z.  has  been  derived  by  many  authors. 

I’sing  either  a queuing  argument  or  some  results  from  renewal  theorv 

we  can  easily  show  that  Z.  follows  a discrete  uniform  distribution 

1 

over  the  values  s.+l,  s.+2,  S.  [l,3,5,7j. 

] 1 1 

Suppose  all  bases  follow  an  (S,S-1)  policy.  Tlien  the  depot 


demand  process  is  also  a Poisson  process  with  rate  X..  Conse- 

1 = 1 T 


quently,  Z^  also  has  a uniform  distribution  in  tins  case.  However, 
if  the  bases  follow  arbitrary  (S,s)  policies,  Z^  may  not  be 
uniformly  distributed.  To  study  this  general  case  we  u e a queuing 
type  analysis.  This  approach  relies  on  the  assumption  tliat  the  under- 
lying process  generating  demands  at  the  bases  is  a Poisson  process. 


4 


We  define  the  ''tate  of  the  system  by  an  (n+l)-tuple  ( i ;k^  ^ ) 

wlu'iv  i I'epi'osents  the  depot  inventory  position,  and  represents 

the  cumulative  number  of  demands  j)lacod  at  base  i since  that  base 
previously  reejuested  resupply.  Then 

ie{sQtl,SQ+2, . . . ,Sq}  and 
k^.E{0,l, . . . ,S^-s^-l}  , j = l,..'.,n. 

Next  let  n represent  the  set  of  (n+l)-tuples  ( i ;k^  , . . . ,k^  ) , Further- 
more, membership  in  is  limited  to  those  (ntl)-tuples  whose  first 

component  represents  a depot  inventory  p)osition  that  is  realizable  given 
the  system  begins  wtien  the  depot  inventory  position  is  . For  example, 

sup'pose  there  are  two  bases  in  the  system  and  they  follow  (5,3)  and  (7,4) 

policies,  respectively.  Then  each  order  placed  on  the  depot  by  base  1 
is  For  two  units  and  eacti  order  placed  by  base  2 is  for  three  units. 
Consequently,  if  the  depot  inventory  position  is  , then  in  the  future 
the  depot  inventory  position  will  never  be  ^^-1.  If,  for  example,  the 
depot  follows  an  (8,4)  policy,  the  realizable  depot  inventory  positions 
are  8,6,  and  5. 

Let  us  now  write  the  transition  probabilities  for  fi.  Let 

0.  = S.-s.,  L = {j:k.=0},  and  P( ( i ;k,  , . . . ,k  );t)  represent  the  nrob- 
T 1 1 J ’In 

ability  the  system  is  in  state  (i;k,  ,...,k  )Efi  at  time  t.  Since  the 

I n 


i 


L 


arrival  process  at  each  base  is  a Poisson  process,  it  follows  that 


pai’ameter  Markov  chain  having  state  space  ft.  Since  tiie  state  space 


is  finite,  the  chain  is  irreducible,  and  the  transition  probability 
functions  are  homogeneous,  the  stationary  distribution  (long-rui.  distri- 
bution) exists  for  the  Markov  chain. 

The  stationary  distribution  for  the  depot  inventory  position  can 
be  obtained  using  the  above  equations.  Denote  the  stationary  probability 
for  state  (i;k. ,...,k  )cn  by  p(i:k, ,...,k  ).  It  is  easy  to  see  that 
the  stationary  probabilities  satisfy 


whenever  L ^ 0 ; and 


^0 


(4)  'l  •••  'l  p(  i ;k  , . . . ,k  ) = 1 . The  set  L 

• i._r\  n 


in  eacii 


i=s.+l  k =0  k =0 
0 1 n 


case  refers  to  the  state  on  the  left  side  of  the  equation. 


Mow  let 


Ql-1  Q^-1 


(5)  71  = I •••  I p(i;k  ,...,k  ) for  i = s +1,...,S 


, ^ ^ - '2,7 

k =0  k =0 
1 n 


Then  tt.  Tneasures  the  stationary  and  long-run  probability  that  the 
depot  inventory  position  is  i.  Thus  we  have  shown  how  to  determine 
the  stationary  probability  distribution  for  depot  inventory  position. 

As  an  illustration,  let  us  find  the  stationary  distribution  for 
the  base  and  depot  inventory  position  for  the  following  situation. 
Suppose  the  system  consists  of  a depot  and  two  bases.  Furthermore, 
suppose  = 1,  = 2,  = 2,  = 3,  s^  = 0,  and  = 2.  Also, 

let's  assume  the  demand  rate  at  base  two  is  twice  the  demand  rate  at 
base  one;  that  is,  2X^  = X^.  Then 

= {(2;0,0),  (2;0,1),  (1;0,0),  (1;0,1)}. 

As  we  observed  earlier,  the  inventory  position  at  each  base  is 
uniformily  distributed  over  the  values  s^+1,  ...,  S^.  Thus  the  prob- 
ability Is  1 that  the  inyentory  position  is  2 for  base  one,  and 
the  probability  the  inventory  position  at  base  two  is  2 or  3 is 


1/2. 


The  probability  distribution 
be  found  using  equations  (l)-(5). 


for  the  depot  inventory  position 
Tor  this  case  the  equations  are 


p(2;0,0)  + p(2;0,l)  + p(l;0,0)  + p(l;0,l) 


= 1 , 


S ^2 

-p(2;0,0)  + p(2;0,l)  + Pd;0,0)  + p(l;0,l)  = 0 , 


\^^2 


XitX2 


XltX2 


A,tA2 


p(2;0,0)  - p(2;0,l) 


V^2 


p(l;0,l)  = 0 , 


p(2;0,0) 


- p(l;0,0) 


= 0 , 


p(2;0,l)  + p(l;0,0)  - p(l;0,l)  = 0 , 


X^tX2 


= p(l;0,0)  + p(l;0,l),  and 
TT^  = p(2;0,0)  + p(2;0,l)- 

The  solution  to  this  set  of  equations  is  p(2;0,0)  = 3/8, 
p(2;0,l)  = 5/16,  p(l;0,0)  = 1/8,  p(l;0,l)  = 3/16,  = 5/16,  and 


can 


11/16. 


r 


1 


1 


n 

I 

j 

i 

I 


i 


nr.  CAgi:  u.  _ ronAL  arrival  raths  and 
nqual  policy  values  at  thd  RAsrr 

!n  the  prevlou:"  section  we  developed  a method  for  finding  tlie  ; rob- 

abilitv  distribution  for  the  depot  inventory  position  when  t!ie  demand 

rate;-,  and  policy  values  were  not  necessarily  the  same  at  all  the  bases. 

We  will  show  in  this  section  that  the  probability  distribution  for  depot 

inventory  position  is  a uniform  distribution  wiien  both  the  demand  rates 

and  policy  values  are  equal  at  all  bases. 

Let  us  now  assume  that  S.=S,s.=s,Q.  = S-s  = Q,  and  X . - \ 

113  1 

^or  all  bases  i = l,...,n.  Then  k^e{0 , . . . ,Q-1) , j = 1 , . . . ,n  . As  a 
consequence  of  these  assumptions  we  can  make  a number  of  observations: 

1.  Since  all  bases  order  Q units  each  time  they  place  a depot 

order,  the  depot  inventory  position  always  equals  one  of  the  values 
:'-j^tQ,  Sq  + ?Q,  ...,  Sq.  In  this  case  it  also  follows  that  and 

should  be  multiples  of  Q. 

2.  The  time  bet-ween  events  (the  arrival  of  a demand  at  some  base 

in  the  system)  is  exponentially  distributed  with  parameter  nA.  Furthei’- 
inoro , the  probability  that  the  next  event  occurs  at  base  j is 


A 1 . . , 

— , for  j = 1 , . . . ,n . 


n n 

I ^ 

i = l 

3.  Since  all  bases  have  identical  demand  rates  and  the  same  policy 
values , 

p(i;k  ,k  , ) = p(i;k  ,k  > • • • ■.!<  ) 

1 1 1 2 2 2 


i 

i 


1 

1 

3 


10 


wh>'nov>‘'r  tito  number'  of  bun 'S  havinr  k . =0  is  m , k.  =1  ir; 

0 

m , , . . . , and  k^.  = Q-1  is  ^ number  of  bases  having 

k.  =0,  k = I,  ...,  k.  = Q-1  is  also  m , m , ...,  m , 

-2  -2  ^2 

respectively,  and  i = l,...,n. 

Define  a state  (1  ;k  , . . . ,k  ) to  be  a neighbor  of  state 

1^  Of 

( i„;k,  , . . , ,k  ) if  state  ( i,  :k,  , . . . ,k  ) can  be  reached  when  a 
2 1 1^  n^ 

transition  occurs  (a  demand  occurs  at  a base)  and  the  state  of  the 

system  is  (i„;k  ,...,k  ).  Then  another  observation  we  can  make  is 
2 1^  n^ 

that  all  states  have  the  same  number  of  neighbors.  In  fact,  the  num- 
ber of  neighbors  is  equal  to  the  number  of  bases  in  the  system. 

The  assumptions  and  observations  imply  that  the  arrival  rate 
into  a state  from  its  neighboring  states  is  the  same  for  all  s‘*ates; 
furthermore,  the  departure  rate  is  the  same  for  all  states,  and,  of 
course,  is  equal  to  the  arrival  rate.  Coml:)ining  this  result  wi*^h  th'' 
fact  that  the  distribution  of  the  time  between  arrivals  to  the  syste"i 
does  not  depend  on  the  state  of  the  system,  we  conclude  that  the  pro- 
portion of  time  the  system  spends  in  each  state  is  the  same  [41. 
Corresponding  to  each  realizable  depot  inventory  position  i there 
are  possible  states  ( i ;k^  , . . . ,k^ ) . Since  the  system  is  e>.uallv 

likely  to  be  in  each  state,  the  depot  inventory  position  is  also 
equally  likely  to  be  in  any  one  of  the  states  i = ,Sj^-Q , . . . ,S^-Sj^  + Q . 

Thus  p(  i ;k^  , . . . ,k^)  = — and  ’’j;  = > for  i c { S^-s^^+Q , . . . ,5^^ } 

Q • M ' 

and  k .e{0  , . . . ,Q-1 ) , j = l,...,n,  where  M = (Sg-s^)/Q. 


We  illustrate  these  oh.".ervut  i ons  using  ttie  following  example. 
Suppose  the  inventory  system  consists  of  a depot  and  two  bases.  Fur- 
thermore, assume  S-s  = Q = 2 and  - 2-Q;  that  is,  M = 2. 

Since  the  arrival  rates  are  the  same  at  each  base,  the  probability 
that  the  next  arrival  to  the  system  occurs  at  either  base  is  1/2. 

Thus  the  following  matrix  is  the  transition  matrix  corresponding  to 
the  embedded  Markov  chain. 


1 1 


(?g;0,0) 


(Sg;i,o) 


(f,;0,i) 


0’  ’ 0’  ’ '“o’  ’ 0 

1/2  1/2 


;i,i) 

(Sq-2;0, 

1/2 

1/2 

1/2 

1/2 

(Sq;1,1) 


(Sg-2;0,0) 


1/2 
1 /2 


1/2 

1/2 


(S^-2;l,0) 


1/2 

1/2 


1/2 

i/2 


(Sj^-2;1,1) 


1/2  1/2 


Observe  that  the  number  of  neighbor  states  for  a given  state  aiu'  the 
number  of  states  for  which  a given  state  is  a neighbor  is  the  same  and 
equal  to  n.  Fur  tliermorc , observe  ttiat  this  transition  matrix  is 
doui)ly  stochastic.  (This  is  also  the  situation  for  all  possible  values 


I 


assit^nod  to  Q,  M and  n.)  An  in  well  known,  when  the  transition 
natrix  is  doiibly  stochastic,  the  probability  that  the  system  is  in 
each  state  is  the  same.  (Tiiis  provides  an  alternative  method  of 
proving  that  for  arbitrary  values  of  Q,  M,  and  n the  probaLil- 
i tv  the  system  is  in  each  state  is  the  same.)  In  this  example  the 
rr'ob.ih i 1 ity  the  system  is  in  each  state  is  1/8.  Furthermore,  the 
prob.ibilitv  that  the  depot  inventory  position  is  either  or 

S^-2  is  1/?. 


We  conclude  this  section  by  observing  that  the  random  variable 


•'O’  ■'!’  •••’  n 


are  independent.  Since  P(Z.=S-k.)  =77,  i =1,.. 


Q 


and  P(Zr,=  i)  = ^ , P(Z.  = i)-P(Z  =S-k,  )•  • -P(Z  =S-k  ) = . 

0 M ’ 0 11  n n 

However,  as  shown  earlier,  this  is  also  the  ioint  probability  of  th 

event  (Z-=i ,Z  =S-k, , . . . ,Z  =S-k  )•  Hence  the  random  variables 
0 1 1 ’ ’ n n 


7 o 

^‘0  ' “1  ’ 


, Z^  are  independent. 
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a .Continuous  review  (S,s)  pol  icy . A.l  1 excess  <lemand  is  assuim'd  1m- korder--' 
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I'lirtlicrmore , thie  process  f.oncratin<’  demand  at  each  base  is  afisumed  to  be  a 
l’oi;;:;on  process.  A simpJe  queuing  analysis  is  used  to  obtiiin  the  probal):  1 i ty 
(list!  ibution  lor  inventory  position.  In  the  case  where  all  baser.  Iiave 
icK'iitieal  arrival  rates  and  follow  the  .same  (S,s)  policy,  v;<;  show  1 1iat 
llie  random  variaiilcs  dcscriljing  the  inventory  position  at  each  locat  ion  <ire 
uiiiiormly  distributed  and  are  independent. 


